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AFFIDAVTr IN SUPPORT OF DECXARATION UNDER 37 C.FJL § 1.131 



Commissioner for Patems 

P.O. Box 1450 

Alexandria, VA 22203-1450 

Sir: 

I, Richard A. Tomlin, a citizen of the United States of America, residing at 5400 N. 
Ocean Blvd, Apt. 54, Fort Lauderdale. PL 33308, hereby declare and state as follows: 

1 . I am employed by International Business Machines Corporation (IBM) of Boca 
Raton, Florida as Consulting Attorney in the Legal Department and I am knowledgeable in the 
procedures employed by IBM in developing and protecting its intellectual property. I make this 
declaration in support of the above-identified applicatioa 

2. IBM has invested substantial time and effort into tiie research, development, and 
marketing of their products, and in an efifort to protect its rights in all new inventions, IBM 
requests that all employees prepare and submit IBM Confidential Invention Disclosure Forms 
upon conception by the inventor(s). 

3. An IBM Confidential Invention Disclosure Form is to be completed by the 
inventor(s) at the time an invention is concaved. 

4. Once an IBM Confidential Invention Disclosure Form has been created, the 
document management system under which IBM Confidential Invention Disclosure Forms are 
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Affidavit in Suppoit of Declaration 

under 37 C.F.R. § 1.131 
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generated does not pennit amendments to the Invention Disclosure Form. Any changes and / or 
additions are appended to an attachment to the Invention Disclosure Form along with a date that 
the attachment was added. Accordingly, No such attachment accompanies IBM Confidential 
Invention Disclosure BOC8-1999-01 13. Consequently, IBM Confidential Invention Disclosure 
BOC8-1999-01 13 has not been amended since the date it was created, November 1 1, 1999. 

5. An IBM Confidential Invention Disclosure Form is intended to provide all 
information necessary for outside legal counsel to prepare an appropriate patent application 
reflective of the disclosed invention when used in conjunction with information known by one 
skilled in the art. 

6. Once an IBM Confidential Invention Disclosure Form has been created, the 
Invention Disclosure Form is reviewed and a decision is made in an expedited manner whether 
to prepare an application on the subject matter. In the above-identified patent application, this 
decision was made and outside counsel was mstructed to prq)are an application on November 
29, 1999. The above-identified patent application was filed June 28, 2000. 

7. I make this Affidavit to establish that the IBM Confidential Invention Disclosure 
Form fully supports the invention as claimed in the above-identified patent q)plication and that 
due diligence was exercised from November 1 1, 1999 through June 28, 2000, the filing date for 
the above-identified patent plication. 

8. I fiirther dedaie that all statements made herein of my own knowledge are true 
and all statements made on information and belief are believed to be true and fiirther that these 
statements were made with the knowledge that willful false statements and the like so made are 
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punishable by fine or imprisonment or both under Section 1001 of Title 18 of the United States 
Code, and that such willful, false statements may jeopardize the validity of the above-identified 
patent application or any patent issuing thereon. 



Richard A. Tomlin 
Date: c>»/o<^y^c>^ 



STATE OF FLORIDA 



COUNTY OF PALM BEACH 



The foregoing instiument was sworn to and subscrib ed before me this j j_ day of. 



/jmu^y- 2004, by RICHARD A TOMLIN, who it ^personally kno\>^ o me or who has 
produced top* of idemifiertion) as identification. 



3^ ELAINE p. VEimiFtElU . 




MY COMMISSION # 00288679 
roF itf>' EXPIRES: Match 14, 2006 
<«o»NorAnv aNoiaiyDiaQeinAaMccai 



NOTARY FUBUC 



(Print, Type or Stamp Commissioned Name of Notary PiibUc 
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Summary 



Required fields are marked with the asterisk (*) and must be filled in to complete the form . 



Status 


Under Evaluation 




Processing Location 


BOC 


Functional Area 


Speech Development, a Customization (0, Osborne) 


Attomey/Patent 
Professional 


Richard Tomlln/Boca Raton/IBM 


IDT Team 




Submitted Date 


11/11/99 03:24:02 PM 


Owning Division 


SWG 










PVT Score 


To calculate a PVT score, use the 'Calculate PVT button. 


Lab 




Technology Code 




Incentive Program 





Inventors with Lotus Notes IDs 

Inventors: Bruce LucasA/Vatson/IBM, Oavid Reich/West Palm Beach/IBM 



Inventor Nanne 

> denotes prinnary contact 



Inventor 

Serial Diy/Dept 



Manager 

Serial Manager Name 



;;y:;^ucas|-Bift^ 




Inventors without Lotus Notes IDs 
IDT Selection 
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Main Idea 



'^itle of disclosure^{iri English) ■ r^^M-^^ 

Method and apparatus for synchronized voice and visual user interface access to Internet web^based 

information 

^^Icifea. of disc Insure ■ ^//r /■-..-:•• ;'V;:yv 

1. Describe your invention, stating the problem solved (if appropriate), and indicating the advantages of 

using the invention. 

The invention, which we have been calling "cobrowsing" is a way to synchronize voice and visual access 
to web data. The idea of the web for HTML is that a browser requests mari^up from a web server. The 
server returns either static or dynamically generated mari^up (HTML) which is rendered by the browser. 
For voice, one could use a voice markup language (such as VoiceXML), but it requires a separate 
browser The problem is how to create a multimodal aspect whereby the visual and voice browsing can 
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be synchronized without writing a new, separate hybrid browser, and without having to write new function 
directly into existing voice or visual browsers. Atter all, nnodifying Netscape or IE is not a realistic 
alternative. 

The solution is cobrowsing. By writing the voice browser as a Java applet, (and using some scripting 
along with it) to be run in the Java "sandbox" under the visual browser, and using existing mari<up tags, 
one can effectively synchronize the voice and visual presentation. (For example, where a user would ' 
say "How do I get from San Francisco to Los Angeles?" and the browser tells him and shows it on a map 
as well, and clicking on say, a highway would enlarge the map and activate some voice output about the 
highway, selected route etc). 

The essence is to have "co-target" type tags that are designed for the "other browser in the cobrowsing 
pair. When a mari<up has a target (such as an "hrer in HTML, a cotarget is specified in the tag as well. 
This causes some script to be executed that passes he data to (or from) the applet that causes the other 
to go visit the co-target. So when the userr clicks on the map, the co-target tells the voice component to 
visit a different URL that has the voice content, and conversely, when the user asks to be shown say, 
San Luis Obispo, the co-target in the voice markup tells the visual browser to visit the appropriate URL. 

2. How does the invention solve the problem or achieve an advantage,(a description of "the invention", 
including figures inline as appropriate)? 

It solves the problem by using existing tags, in exising markup languages, with an innovative use of 
scripting and applets to make cooperating applications (actually, it can be viewed as one application 
since they are coperating now) without reprogramming of either of the applications, making it cost 
effective and practical, 

3. If the same advantage or problem has been identified by others (inside/outside IBM), how have those . 
others solved it and does your solution differ and why is it better? 

The only other solution currently proposed is proposed by Microsoft, and their solution is to build speech 
into their browser and add a set of new speech tags to HTML. This is a proprietary solution and attempts 
to hijack the HTML specification, and the industry has vocally rejected this plan. 

4. If the invention is implemented in a product or prototype, include technical details, purpose, disclosure 
details to others and the date of that implementation. 

It is implemented in a prototype and has only been shown intemally. The implementation was around 
April, 1 999 and was written for Windows NT only. It essentially uses the voice browser and a visual 
browser, and uses JavaScript and the Java plug-in API to perform the actual information passing to 
perform the synchronization. 

•Critical Questions ( Questions 1 - 7 must be answered) 
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Isyhereiahy biG^;:aiGtual publication ofedisclb^ of your invention to anyone outside^ 3 


&fio.^y[ 


;lf^y^s,.:Ehterthe name of each publication orpatent and the- date. published below; ■ 

BOate^Pubiished or IssuedrThiais^pianned for a product ■in;the "invoice" project-^ "\ : ■ 


^e--you^;aW^ of any, publications, prpduGtsx)f patents thattelate to;ihis invention?:,-: 


#. No 


If yes,. Enter the name=of isach publication orpatent and the date published belovy; : ' ; ' - 

^jg-iDatePubiished or Issued;. • \ ■•;v:s- ^^^^^ .w..^' /...V:;' A.. y \r:^^^:'y^i:j^^^ 
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Was the s^bject matterM 

public;i:^;g:;j:outsidb :iBM in the- presenbe of , ribri-'lBMer^f ; 



;e& 



If yes^j give; a date ^ Pliease format the date as MWDDfYYmX 



Have you ever discussed your inverition with pthers not enipicfyed -at lBM? 



0;.Yes;- 
No':";' 



If yes^ identify individuals and datextiscussed.^Fllt in the text areaMh the following informatibrKithe r 
name^ 0f the individuals, the employer, date discussed, under CDA^ a^ CDA fct ■ -^^^^^ 



yVas the^^ in any way, started or 



brprqject^:^ 



O-Ntrtisure; 



IfYes^ enter the contract number 



Was the^^^^^^ made in the cou^se-of any alliance, joiritd^^^ or dther contract : 

adiyities?^"-';^'-' .'v.. ^v:■v■V..^^^^'^^•:;■■.^^^^^ 



If Yes; enter the following :Name of Alliance, Contractor of^ Joint Developer 



D:Ndt-Sure 



Contract ID huhiber 



Relationship contact name j ^ 



Relationship: contact E-mait- 



Relationship contact phone - 



QuestipHvE-' 

Haveyduiisubmitted^ br ^ you aware of, any related disclosujre sUbm 



No: 



If Yes(. pliBase provide the title and docket or disclosure number. befow: 
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DECLARATION UNDER 37 C-RR. § L131 



Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22203-1450 



I, Bruce D. Lucas, a citizen of the United States of America, residing at 1285 Sunny 
Ridge Road, Mohegan Lake, NY 10547, hereby declare and state as follows: 

1. t was employed by International Business Machines Corporation (IBM) of Boca 
Raton, Florida at the time the above«identiiied application was conceived and continue 10 be 
employed by IBM. I make this declaration in support the above-identified {qsplication. 

2. IBM has invested substantial time and effort into the research, development, and 
marketing of their products, and in an effort to protect its rights in all new invmtions, IBM 
requests that all employees prepare and submit IBM Confidential Invention Disclosure Formg 
upon conception by the invmtor(s). 

3. As a named inventor for this invention, my co-invemor and I submitted the 
attached IBM Confidential Invention Disclosure B0C8-1 999^1 13, 

4. I make this Declaration to establish that my co-inventor and I conceived of the 
present invention at least as early as November 1 1, 1999, and exercised due diligence from prior 
to November 11, 1999 through June 28, 2000, the filing date for the above-idwitified patent 
application. 



(WPi647oa;i} 



TO 915616596313 P. 02 



S. I further declare that all statemenis made herein of my own knowledge are tru3 
and all statements made on infonnadon and belief are believed to be true and further that thes j 
statements were made with the knowledge that willful false statements and the like so made axc 
punishable by fine or imprisonment or both under Section 1001 of Title 18 of the United States 
Code, and thai such willful, false statements may jeopaidize the validity of the above-identified 
patent application or any patent issuing there ^.^ ^ 




Bruce D. Lucas 



Date: 



COUNTY OF 



STATE OF 





The foregoing instrument was sworn to and subscribed before me this / day of. 



, 2004, by BRUCE D, LUCAS, who is personally known to me or who has 

produced '^XJbM ^a^^. (type or iteuification) as identification. 





J NOTARY PUBLIC 1} ^ 



(Print, Type or Stamp Commissioned Name of 
Notary Public) 




NOTARY PyeLlC. State of New Yc/k. 
^- No, 01GR493S297 



t 
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DECLARATION UNDER 37 CFJL § 1.131 



Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22203-1450 



Sir; 



I, David E; Reich, a citizen of the United Slates of America, residing ai 6884 Inland 
Court, Jupiter, FL 33458, hereby declare and state as follows: 

6. I was employed by International Business Machines Corporation (IBM) of Boca 
Raton, Florida at the time the above-identified application was conceived and continue to be 
employed by IBM. I make this declaration in support the above-identified application. 

7. IBM has invested substantial time and effort into the research, development, and 
marketing of their products, and in an effort to protect its rights in all new inventions, IBM 
requests that all employees prepae and submit IBM Confidential Invention Disclosure Forms 
upon conception by the inventor(s). 

8. As a named inventor for this invention, my co-inventor and I submitted the 
attached IBM Confidential Invention Disclosure BOC8-1999-01 13. 

9. I make tiiis Declaradon to establish that my co-inventor and I concjeived of the 
present invention at least as early as November 1 1, 1999. and exercised due dUigence firem prior 
to November 11, 1999 through June 28, 2000, the filing date for the above-identified patent 
application. 
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10. I further declare thai all statements made herein of my own knowledge are true 
and all statements made on infonnation and belief are believed to be true and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine Or imprisonment or both under Section 1001 of Tide 18 of the United States 
Code, and that such willful, felse statements may jeopardize the vaUdity of the above^dmtified 
patent application or any patem issuing thereon. 




David E. Reich 



STATE OF FLORIDA ) 

) ss: 

COUNTY OF PALM BEACH ) 



4f4T^ MY COMMISSION* 00 038911 
M-^^ EXPiRES:Oclober30,200S 

Vf^vg^ BOMM Thni Notuy Publie UndcM.tus 



nie foregoing instrument was sworn to and subscribed before me thia^l^y ^iJ2^^f ^ 
^, 2004, by DAVID E. RHCH, who is personally known to me or who has 



py^fj^iP^^ j^.'^.-^^y _ (type of idoitificaion) as idcntificatian. 




' .-^^^-'-'^ 

NOTARY PUBLIC, 



JTATE OF FLORIDA 

^ /^-S^ ^^^^'^^ (ftiii^Type or Stanip Commissioned WOT^ 



(yvpi6a708-.i) 



